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RISK, AMBIGUITY, AND THE SAVAGE AXIOMS 
Daniel Ellsberg* 

The RAND Corporation, Santa Monica, California 

I. ARE THERE UNCERTAINTIES THAT ARE NOT RISKS? 

There has always been a good deal of skepticism about the behavioral 
significance of Frank Knight's distinction between "measurable uncertainty" o 
"risk," which may be represented by numerical probabilities, and "unmeasurah" 
uncertainty" which cannot. Knight maintained that the latter "un rtainty" 
prevailed -- and hence that numerical probabilities were inapplicable -- in 
situations when the decision-maker was ignorant of the statistical freque. - 
cies of events relevant to his decision; or when a priori calculations were 
impossible; or when the relevant events were In some sense unique; or when a; 
important, once-and-for-all decision was concerned.^" (For this and subseque 
footnotes, see end of paper.) 

Yet the feeling has persisted that, even in these situations, people ten 
to behave "as if" they assigned numerical probabilities, or "degrees ol 
belief," to the events impinging on their actions. However, it is hard elthe 
to confirm or to deny such a proposition in the absence of precisely-defined 
procedures for measuring these alleged "degrees of belief." 


« 

Any views expressed in this paper are those of the author. They should 
not be interpreted as reflecting the views of The RAND Corporation Or the 
official opinion or policy of any of its governmental or private research 
sponsors. Papers are reproduced by The RAND Corporation as a courtesy to 
members of it3 staff. 

Research for this paper was done while the author w &3 a member of the 
Society of Fellows, Harvard University, 1957* An earlier version was read 
before the Econometric Society at its December 19 <j 0 meeting in 3t. Louis; 
and the present version incorporating changes in Section III will appear in 
the November 1961 issue of the Quarterly Journal of Economics , in a syepoaium 
on decision-making under uncertainty, together with a contribution by 
William Feliner and a note on the present paper by Howard Raiffa. In re¬ 
vising Section III, the author was particularly stimulated by discussions 
with A. Madansky, T. Schelling, L. Shapley, and S. Winter. 
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What might It own operationally, in terns of refutable predictions about 
observable phenomena, to say that someone behaves "as if" he assigned quanti¬ 
tative likelihoods to events: or to say that he does not? An intuitive 
answer may emerge if we consider an exanple proposed by Shackle, who takes 
an extreme form of the Knightian position that statistical information on 
frequencies within a large, repetitive class of events is strictly irrelevant 
to a decision whose outcome depends on a single trial. Shackle not only 
rejects numerical probabilities for representing the uncertainty in this 
situation; he maintains that in situations where all the potential outcomes 
seem "perfectly possible" in the sense that they would not violate accepted 
lavs and thus cause "surprise," it is impossible to distinguish meaningfully 
(i.e., in terms of a person’s behavior, or any other observations) between 
the relative "likelihoods" of these outcomes. In throwing a die, for instance, 
it would not surprise us at all if an ace came up on a single trial, nor if, cr 
the other hand, earn other nutter came up. So ftackle concludes: 

3uppose the captains In a Test Match have agreed that Instead of 
tossing a coin for a choice of Innings they will decide the 
matter by this next throw of a die, and that if it shows an ace 
Australia shall bat first, if any other number, then England 
shall bat first. Can we now give any meaningful answer whatever 
to the question, "Who will bat first?" except "We do not know?"2 

Most of us might think we could give better answers than that. We could 

say, "England will bat first," or mors cautiously: "I think England will 

probably bat first." And if Shackle challenges us as to what wo "mean" by 

that statement, it is quite natural to reply: "We’ll bet on England; and 

we'll give you good odds." 

It so happens that in this case statistical information (on the 
behavior of dice) is available and does seer, relevant even to a "single 
3hot" decision, our bet; it will affect the odds we offer. As Damon Runycn 
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once Mid, "The race Is not always to the swift nor the battle to the 
strong, but that's the way to bet." However, It is our bet itself, and not 
the reasoning and evidence that lies behind it, that gives operational 
meaning to our statement that we find one outcome "more likely" than 
another. And we nay be willing to place bets — thus revealing "degrees 
of belief" in a quantitative form -- about events for which there is no 
statistical information at all, or regarding which statistical information 
seems in principle unobtainable. If our pattern of bets were suitably 
orderly — if it satisfied certain postulated const mints --it would be 
possible to infer for ourselves numerical subjective probabilities for 
events, in terms of which some future decisions could be predicted or 
described. Thus a good deal -- perhaps all -- of Knight's class of 
"unmeasurable uncertainties" would have succumbed to measurement, and 
"risk" would prevail Instead of "uncertainty." 

A number of sets of constraints on choice-behavior under uncertainty 
have now been proposed, all more or leas equivalent or closely similar in 
spirit, having the implication that — for a "rational" man — all uncer¬ 
tainties can be reduced to risks.^ Their flavor is suggested by Ramsay's 
early notions that, "The degree of a belief is.. .the extent to which we 
are prepared to act upon it," and "The probability of l/3 is clearly 
related to the kind of belief which would lead to a bet of 2 to l."* 1 
Starting from the notion that gambling choices are influenced by, or 
"reflect," differing degrees of belief, this approach sets out to infer 
those beliefs from the actual choices. Of course, in general those choices 
reveal not only the person's relative expectations but his relative prefer¬ 
ences for outcomes; there is a problem of distinguishing between these. 


tut If one picks the right choices to observe, and If the Savage postulates 
>r some equivalent set are found to be satisfied, this distinction can be 
ade unambiguously, and either qualitative or, ideally, numerical proba- 
llities can be determined. The propounders of these axioms tend to be 
opeful that the rules will be commonly satisfied, at least roughly and 
cat of the time, because they regard these postulates as normative maxims, 
ldely-acceptable principles of rational behavior. In other words, people 
hould tend to behave In the postulated fashion, because that Is the vay 
hey would want to behave. At the least, these axioms are believed to 
redlct certain choices that people will make when they take plenty of 
lne to reflect over their decision, In the light of the postulates. 

In considering only deliberate decisions, then, does this leave any 
oaa at all for "unmeasurable uncertainty*: far uncertjinties not raduc- 
ble to "risks," to quantitative or qualitative probabilities? 

A side effect of the axiomatic approach is that it supplies, at last 
as Khlght did not), a useful operational meaning to the proposition that 
eople do not alioys assigned, or act "as though" they assigned, probab 11- 
ties to uncertain events. The meaning would be that with respect to 
ertaln events they did not obey, nor did tney wish to obey — even on 
e flection — Savage's postulates or *quivalen* rules. One could emphasise 
ere either that the postulates fh*'cl to bo acceptable In those circuo- 
tanoes as normative rules, or that they failed to predict reflective 
holces; I tend to be more interested in the letter aspect, Savage no 
oubt In the former. (A third Inference, which H. Haiffh favors, could be 
hat people need more drill on the importance of conforming to the Savage 
xiocs.) But from either point of view, it would follow that there would 
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be simply no way to Infer meaningful probabilities for those events from 

their choices , and theories which purported to describe their uncertainty 
In terns of probabilities would be quite inapplicable in that area (unless 
quite different operations for measuring probability were devised). More¬ 
over, such people could not be described as maximising the nathenatlcal 
expectation of utility on the basis of numerical probabilities for those 
events derived on any basis. Nor would it be possible to derive numerical 
"von Neuaann-Morgenstern ’ utilities from their choices among gambles 
involving those events. 

I propose to indicate a class of choice-situations in which many 
otherwise reasonable people neither wish nor tend to conform to the 
Savage postulates, nor to the other axiom sets that have been devised. 

But the implications of such a finding, if true, are not wholly destructive. 
First, both the predictive and normative use of the Savage or equivalent 
postulates might be Improved by avoiding attempts to apply them in certain, 
specifiable circumstances where they do not seem acceptable. Second, ve 
might hope that it is precisely in such circumstances that certain 
proposals for alternative decision rules and non-probabllistic descriptions 
of uncertainty (s.g., by Khlght, Shaokle, Burwlcz, and Bodges and Lehmann) 
might prove fruitful. I believe, in fact, that this ia the case. 




n. uncsBTAixms that are m risks 


Which of tvc events, at, p, does an Individual consider "more likely"? 
In the Ronacy-Savage approach, the basic test 1st On vhlch event would 
he prefer to stake a prise, or to place a given bet? By the phrase, 

"to offer a bet on ff* ve shall mean: to make available an action vlth 
consequence a if a occurs, (or, as Savage putc It, If a "obtains") 
and b if * does not occur (i.e., if 5, or "not-a" occurs), where a 
ic preferable to b. 

Suppose, then, that ve offer a subject alternative bets "an" cl 
und "on” p (a, p need not be either mrtuaUy exclusive or exhaustive, 

but fbr ee n wa ian e e m Anil mmmm la all Uluatarmtloas that they are 

•rants 

autaally exclusive). a p &r& 

I 

Charles 

n 

The Rams^r-gavage proposal Is to interpret the persen's preference 
between I ard II as revealing the relative likeliheod h n assigns to a 
and p. If he does not definitely prefer II to I, It :ls te be Inferred 



that he regards a as "net lass probable than” P, which ve will write: 

a - p. 


For example, in the case of Crackle '0 Illustration, ve might be 
allowed to bet either that England will bat first or that Australia 
will (these two events being complementary), staking a $10 prize in 


either cane: 


England first Australia flrst 


I 


$10 
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If the event were to be determined, by the toM of a die, rin g ! e nd to bet 
first if any amber but an ace turned up, I would strongly prefer 
gpwKie i (and If Ebackla *hr»»id really claim indifference between I and II, 

I would be arptjmie to make a side bet with him)* If, on the other hand, 
the captains were to toss a coin, I would be indifferent between the two 
beta. In the first case an observer might infer, on the basis of the 
Rmaaey-Savage axioms, that I regarded Bn gland as more likely to bat first 
than Australia (or, an ace as less likely than not to caae up); in the 
second case, that I regarded Beads and Tails as "equally likely." 

That Inference yould, in fact, be a little hasty. Ky indifference 
in the second case would indeed indicate that I assigned equal probabilities 
to Beads and Tails, if I assigned any probabilities at all to those events ; 
but the latter condition would remain to be proved, and it would take 
further choices to prove it. I might, for example, be e "minimaxer," 
whose indifference between the two beta merely reflected the fact that 
their respective Verst outcomes" were Identical. To rule out such 
possibilities, it would be neeessary to exanlne my pattern of preferences 
in a number of vell-choaen caees, in the ligit of certain axiomatic 
constraints. 

In order for any relationship ( 3 )among events to have the properties 
of a "qualitative probability relationship,” it must be true that: 

(a) CD 1» • complete ordering over events; for any two events a, P, 
either a is "not less probable than" P, or P is "not lest probable than" 
a, and if a > p and p > 7 , then a > j. 

(b) If a is more probable than p, then "not-O" (or, 5) is less probable 
than not-P <»)j If a is equally probable to 5, and p is equally probabJe 
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to 0, than a la equally probable to 0. 

(c) If <2 end 7 are mutually exclusive, end ao are 0 end 7 ( 1 .*., If 0^7 ■ 
0/^7= 0), and if a it more probable than 0, than the union {auy ) it more 
probable than (0w7 ). 

Savage proves that the xelationahip(>)among event*. Inferred aa above 
from choice* among gamble*, will have the above properties if 
the individual'■ pattern of choice* obeys certain postulate*. To Indicate 
sane of these briefly: 

FI: Complete ordering of gamble*, or "actions." In the example 
below either I 1* preferred to II, II 1* preferred to I, or I and II are 
indifferent. If I 1* preferred to II, and II la preferred or Indifferent 
to III, then I la preferred to HI (not shoac). 


I 

II 

P2: The choice between two actions euat be unaffected by the value 
of payoff* corresponding to events for which both aetlana have the same 
payoff (1.*., by the value of payoffs in a constant column ). Thus, If 
the subject preferred I to II In the aacwple above, he should prefer 
III to IV, belov, when a end b ere unchanged end c takes any value: 

a 0 5/iP 

m 

IV 

This correspond* to Savage'* Fcetulat# 2, which ha call* the "Sure- 
Thin g Principle" and which beer* greet weight in the analysis. One 
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ratlooale for It Mounts to the following! Suppose that a parson would 
not profsr If to HI if ha knew that ths third coiusn would not "obtain”} 
if, on ths othar hand, ha knew that tha third column would obtain, ha 
would still not prafar IV to HI, since tha payoff* (whatever they are) 
are equal. So, since ha would not prefer IV to HI "in either event,” 
be should not prefer IV whan ha does not know whether or not tha third 
colam will obtain. 

"Accept possibly for tha assMption of simple ordering,” Savage 
asserts, "I know of no other astrological principle governing decisions 
that finds such ready acceptance. 

Ft: The choice in the above ***t~ > * oust be independent of the value* 
of a and b, given their ordering. Sms, preferring t to H, the subject 
should prefer V to VI below. 


▼ 

VI 

Shis is Savage's foetulete 4, the independence of probabilities and pay¬ 
offs. Roughly, it specifies that the choice of event on which a person 
prefers to stake s prise should not be affected by the else of the prite. 

In combination with a "non-controversial" Postulate ?3, (corresponding 
to "admissibility", the rejection of dominated actions), these four 
postulates, if generally satisfied by the individual' * choices. Imply 
that his preference for I over H ( or HI over IV, or V over VI) may 
safely be interpreted as sufficient evidence that he regards a as "not 
less probable than" fij tha relationship "not 1-w probable than" thus 
operationally defined , will have all the properties of a "qualitative 


when d > e t 
a p 
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probabillty relationship." (Otter postulatss, idileh will not te 
considered ter*, art necessary in ord*r to •«tabll*h m—rlcal probabU- 
ltl**.) Ut general, a* on* ponder* tteaa postulate* and tssts ttem intro- 
spectlvely in a variety of hypothetical situation*, ttey do lndaad appear 
plausible. That Is to say that ttey do seen to bare vide validity 
as ooraatlre criteria (for m, as well as for Savage); ttey are probably^ 
roughly accurate In predicting certain aspects of actual choice behavior 
lr. may situations and better yet In predicting reflective behavior In 
those situations. To the extent this is true. It should be possible to 
Infer froa certain galling choices in those situations at laast a 
qualitative probability relationship oner events, c or re spo nding to a 
given person’* "degree* of belief." 

Let us now consider sons situations in which the Savage axiom dc 
not taea so plausible: nlrm—tianoes in which none of the above conclu¬ 
sions oay appaer valid. 

Consider the following hypothetical experiment. Let us suppose 
that you c onfron t two urns c o ntaining rod and black balls, froa ans of 
which a ball will be drawn at randoa. to "bet on Redj" will assn 
that you choose to draw froa Urn X; and that you will receive a prise a 
(say $100) If you draw a rad ball ("If ted^ occurs") and a saallsr 
amount b (say, $0) if you draw a black ("if not-Asd^ occurs"). 

You have the following lnfonatlon. Urn I contains 100 red and 
black bfkJ.a, but In a ratio entirely unknown to you; there oay be from 
0 to 100 red balls. In Urn II, you confirm that there are exactly 50 
red and 50 black bolls. An observer — who, let us say, la Ignorant of 
the state of your information about the urns -- seta out to measure 
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your subjective probabl IItl— by interro^tlng you as to your pnftnocti 

la the following pair* of pmblmmi 

L. "Which do you proffer to hot oo, lodj or Blackyi or or* you 

lnh lftmt l" That U ( drawing a ball from On I, oo which "event* do 

you proffer tbo $100 state, ted or Black: or do yuu carol 

8. "Which would you proffer to hot oo, Mq or Blaek^T" 

3. "Which do you pr offe r to bet oo, tedj or ted^f"^ 

k. ^fclch do you proffer to bet oo. Blacky or BlackyT"^ 

Iat ua suppose that in both the firot caae and the aaceod caae, you 

a 

are indiffferaot (the typical response). Judging fraa a large nwber of 
re^oMfea, under abeelutaly non wpwrlaaatal ceodltiooa, your answers to 
thaaa laet two |»i>1om are likely to fall into one of three group#. You 
aagr etill be indiffferaot within eaeh pair of options. (If ao, you nay ait 
back new ate watah for aahila). Bat if you art in tha majority, you will 
r apart that you p rater to bat aa ted n ratter ttea Bedj, and Bl a cky 
ratter than Blaak^. fte prafferaooaa of a aaall minority un tha other way, 
prafarrlng beta on ted^ to ted^, and Blacky to Blacky* 

If you art la either of tteee latter grobpe, you are now in trouble 
with tha tevaga artona. 

Buppoaa that, bet* 'ng oo ted, you preferred to draw out of Urn II. 

An observer, applying the basic rule of the Bansay/Savage approach, 
would, infer tentatively that you regarded Bed^j aa "sore probably than" 
Red^.. he then obaervea that you alao prefer to bat on Blacky rather 
than Blacky. L. .ce he cannot conclude that you regard Red^ aa more 
probable than Red. at tha aaae time, not-Red^ aa more probable 
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id not-Aed^ — this being inconsistent with tbe essential pr op er ties of 
robebillty relstleoahipe — be oust conclude thst your choices ere 
t reveellng Judgements of "probability" st ell. So fsr es these events 
e concerned. It is lfoeeihls to Infer probebllltles from your choices; 
u euet inevitably be vloletlng sc mm of the Ssvege axioms (specifically, 
end K, complete ordering of actions and/or the Sure-thing Principle).^ 

Ihe see applies If you pi e f e r rsd to bet on Sed^ end Blacky rether 
an *•*11 or Blacky. Moreove r , harking beck to your earlier (hypothetical) 
piles, any one of these preferences Involves you In conflict with the 
leas. for if one is to Interpret from .our answers to the first two 
•stIons thst Redj is "e«islly likely* to not-Medj, and Rsd^ Is equally 
icely to not-Ssd^, thso Asdj (or Blacky) should be totally 1^.^, to 

(or to Blacky), and soy preference for drawing from one urn over 

• other leads to s ocntradletlan.^ 

Xt aigrt be dbjsated that the > 1 —Wl total lgwrance of the ratio 

• grig Kail m ip (jm x Is an unrealistic condition, l se dlng to 

Tetlc dseltlsos. Let us sujfsss instead that you have been allowed to 
«v a raadoa sn^le of two balls froe Urn X, and that you have drawn one 
4 and one black* Or a sample of fouri two red and two black. Such 
editions do net seee to change the observed pattern of choices appreciably 
1 though the reluctance to drew from Urn X goes down eamevhat, as shown 

,r example, by the mount e subject will pay to drew from U!m I; this 
ill remains well below whet he will pay for Ukn n). The same conflicts 
th the axioms appear. 

long after beginning these observations, I discovered recently that 
light had postulated an identical comparison, between a man who knova thst 
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there are red and black balls in an am but Is ignorant of the numbers 
of each, and another who knows their exact proportion. The results 
indicated above directly contradict Bright'8 own intuition about tire 
situation: "It must be admitted that practically, if any decision as to 
conduct is involved, such as a wager, the first man would have to act on 
the supposition that the chances are equal.If indeed people were 
ca.rpelled to act on the basis of some Principle of Insufficient Reason 
when they lacked statistical information, there would be little interest 
in Bright's own distinctions between risk and uncertainty so far as 
conduct were involved. But as many people predict their own conduct in 
such hypothetical situations, they do not feel obliged to act "as if" 
tuey assigned probabilities at all, equal or not, in this state of 
i.jio ranee. 

Another example yields a direct test of one of the Scvage post'iiduc:?. 
Imagine an urn known to contain 30 red balls and 60 black and yellow balls, 
the latter in unknown proportion. (Alternatively, Imagine that a sample 
of two drawn from the 60 black and yellow balls has resulted in one Hack 
and one yellow). One ball is to be drawn at random from tne urn; 
tire following actions are considered t 



30 


63 



Red 

Black 


Yellow 

I 

$100 

$0 


$0 

II 

$0 

$100 


$C 

Action I is "a bet on 

Red," II Is "a bet or. 

Black." 

Which do you prefer'.’ 

.'low consider the 

following two actions, under the 

sane circumstances 


30 


6o 
_^ 



Red 

Black 


Yellow 

III 

$100 

$0 


$100 

IV 

$0 

$100 


$100 





action III is a "bet on Red or Yellow"} IV la a "bet on Black or Yellow." 
Which of these do you prefer? Take your tine I 

A very frequent pattern of reeponae is: action I preferred to II, 
and IV preferred to III. Lees frequent 1st II preferred to I, and III 
preferred to IV. Both of these, of course, violate the Sure-thing 
Principle, which requires the ordering of I to n to be preserved in 
III and IV (since the two pairs differ only in their third column, 
constant for each pair). 11 The first pattern, for example, Implies that 
the subject prefers to bet "on" Red rather than "on" Black; and he also 
prefers to bet "againat’’ Red rather than "a§pinst" Black. A relationship 
"tr.oro likely than" inferred from his choices would fail condition (b) above 
of a "qualitative probability relationship," since it would indicate that 
.is regarded Red as more likely than Black, but also "not-Red" as more 
likely than "not-Black." Moreover, ha would be acting "as though" he 
retarded "Red or Yellow" as lass llkaly than "B la c k or Ysllow," although 
Red were more llkaly than Black, and Rad, Yellow and Black were mutually 
exclusive: thus violating condition (c) above. 

Once again, it is Impossible, on tbs basis of such choices, to infer 
oven qualitative probabilities for the events in question (specifically, 
for events that include Yellow or Black, but not both). Moreover, for any 
-/clues of the payoffs, it is impossible to find probability numbers in 
terns of which these choices could be described — even roughly or 

lk 

approximately — as maximizing th mathematical expectation of utility. 

You night now pause to reconsider your replies. If you should repent 
of your violations — if you should decide that /our choices Implying 
conflicts with the axiom were "mistakes" and that your "real" preferences, 
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upon reflection. Involve no such inconsistencies — you confirm that the 
Savage postulates are, if not descriptive rules for you, your normative 
criteria In these situations. But this Is by no means a universal 
reaction; on the contrary, it would be exceptional. 

Responses do vary. There are those who do not violate the axioms, 

or say they won't, even In these situations (e.g., G. Debreu, R. Sc hla lffer 

P. Samuelson); such subjects tend to apply the axioms rather than their 

intuition, and. when In doubt, to apply some form of the Principle of 

Insufficient Reason. Some violate the axioms cheerfully, even with gusto 

(J. M&rschak, N. Dalkey); others sadly but persistently, having looked 

Into their hearts, found conflicts with the axioms and decided, In 

1 ^ 

Samuelson's phrase, to satisfy their preferences and let the axioms 
satisfy themselves. Still others (H. ffciffa) tend, Intuitively, to 
violate the axioms but feel guilty about It and go back into further 
analysis. 

The Important finding Is that, after re-thinking all their "offending" 
decisions In the light of the axioms, s number of people who are not only 
sophisticated but reasonable decide that they wish to persist in their 
choices. This Includes people who previously felt s "first-order 
commitment" to tbs axioms, many of them surprised and some dismayed to 
find that they wished, In these situations, to violate the 3ure-thing 
Principle. Since this group Included L. J. Savage, when last tested by 
me (I have been reluctant to try him again). It seem a to deserve respect¬ 


ful consideration. 
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m. why are some uicertaiwim war risks? 

Individuals who would choose I over II and IV over III In the example. 
above (or, II over I and III over IV) are simply not acting "as though" 
they assigned numerical or even qualitative probabilities to the events in 
question. There are. It turns out, other ways for them to act. But what 
are they doing? 

Even with so few observations, it Is possible to say sane other 
things they are not doing. They are not "minimalng"; nor sue they applying 
a "Burvicz" criterion," maximizing a weighted average of minimum payoff 
and ^ftvtmnm for each strategy. If they were following any such rules 
they would have been indifferent between each pair of gambles, since all 
have identical miniaa and maxima. Moreover, they are not "minimaxing 
regret," since in terns of "regrets" the pairs I-II and III-IV are 
identical. 3,1 * 

Thus, none of the familiar criteria for predicting or prescribing 
decisionmaking under uncertainty co r responds to this pattern of choices. 

Yet the choices themselves do not appear to be careless or random. They 
are persistent, reportedly deliberate, and they seem to predominate 
empirically; many of the people who take than are emi nen tly 
reasonable, and they insist that they want to behave this way, even though 
they may be generally respectful of the Savage axioms. There are strong 
indications, in other words, not merely of the existence of reliable 
patterns of blind behavior but of the operation of definite normative 
criteria, different from and conflicting with the familiar ones, to which 
these people are trying to conform. If we are talking about you, among 
others, ve might call on your introspection once a^in. What did you 
think you were doing? What were you trying to do? 
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Cne thing to be explained le the fact that you probably would not 
violate the axioms In certain other situations. In the urn example, 
although a person’s choices way not allow us to infer a probability for 
Yellow, or for (Red or Black), we nay be able to deduce quite definitely 
that he regards (Yellow or Black) as "wore likely than" Red; in fact, we 
might be able to arrive at quite precise numerical estimates for his 
probabilities, approximating 2 / 3 , l/3* What is the difference between 
these uncertainties, that leads to such different beharior? 

Responses from confessed violators Indicate that the difference is 
not to be found in terms of the two factors couaonly used to determine a 
choice situation, the relative desirability of the possible payoffs and 
the relative likelihood of the events affecting them, but in a third 
dimension of the problem of choice: the nature of one's information 
^ concerning the relative likelihood of events. What Is at issue might be 
called the ambiguity of this information, a quality depending on the 
amount, type, reliability and "unanimity" of information, and giving 
rise to one's dafras of "confidence" in an estimate of relative likelihoods. 

8uoh rules as ndnl—slnf, maxlmsKlng, Hurwlcs criteria or mlniraaxing 
regret are usually prescribed for situations of "complete ignorance," 

In which a decisionmaker lacks any information whatever on relative 
likelihoods. This would be a case in our urn example if a subject had no 
basis lbr considering any of th* possible probability distributions over 
Red, Yellow, Black — such as (1,6,0), (0,1,0), (0,0,1) -- as a better 
estimates, or basis for decision, than any other. On the other hand, the 
Savage axioms, and the general "Bayesian" approach, are unquestionably 
appropriate when a subject Is willing to base his decisions on a definite 
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tad precise choice of a particular distribution: his uncertainty in such 
a situation is unequivocally In the ftom of ’’risk." 

But the state of information in our um example can be characterised 
neither as "Ignorance" nor "risk" In these senses. Each subject does 
>cnov enough about the problem to rule out a nusher of possible distribu¬ 
tions, including all three mentioned above. He knows (by the terns of 
the experiment) that there are Red balls in the urn; in fact, he knows 
that exactly l/3 of the balls are Red. Thus, in his "choice" of a sub¬ 
jective probability distribution over Red, Yellow, Black — if he wanted 
such an estimate as a basis for decision — he is limited to the set of 
potential distributions between (1/3* 2/}, 0) and (l/3> 0, 2/5): i.e., to 
the Infinite set (l/3A> 2/3-k), 0 <\< 2/3 . lacking any observations 

?n the number of Yellow or Black balls, he may have little or no information 
Indicating that one of the remaining, infinite eet of distributions is 
nore "likely," mors worthy of attention than any other. If iie should 
icemulate soot observations, in the form of small sample distributions, 
this set of "reasonable" distributions would diminish, and a particular 
iistribution might gather Increasing strength ss a candidate; but so long 
is the samples remain mall, be may be far from able to select one from a 
lumber of distributions as a unique basis for decision. 

In some situations where two or mors probability distributions over 
the states of nature seem reasonable, or possible, it may still be 
possible to draw on different aorta of evidence, establishing probability 
weights In turn to these different distributions to arrive at a final, 

:opposite distribution. Even in our examples, it would be misleading to 
place much emphasis on the notion that a subject has no information about 
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the contents of an urn on which no observations have been node. The subje 
can always ask himself: "What is the likelihood that the experimenter har> 
rigged this urn? Asswlng that he has, what proportion of Red balls did 
be probably set? If he Is trying to trick me, how is he going about it? 
What other bets is he going to orfer me? What sort of results is he after 
If he has had a lot of experience with psychological tests before, he may 
be able to bring to bear a good deal of lnfomatlon and intuition that 
sesms relevant to the problem of weighting the different hypotheses, the 
alternative reasonable probability distributions. In the end, these 
weights, and the resulting composite probabilities, may or may not be 
equal for the different possibilities. In our examples, actual subjects 
do tend to be indiffere nt between betting on Red or Black in the 
unobserved urn, in the first case, or between betting on Yellow or Black 
in the second. This need not at all assn that they felt "completely 
ignorant" or that they oould think of no reason to favor one or the other; 
it does indicate that the reasons, if any, to favor one or the other 
balanced out seffectively so that the possibilities entered into their 
final decisions weighted equivalently. 

Let us as subs, for purposes of discussion, that an individual can 
always assign relative weights to alternative probability distributions 
reflecting tbs relative support given by his lnfomatlon, experience and 
intuition to these rival hypotheses. This implies that he can always aasi t 
relative likelihoods to the states of nature. But how does he act in the 
presence of his uncertainty? The answer to that may depend on another 
sort of Jud^aent, about the reliability, credibility, or adequacy of his 
Information (including his relevant experience, advice and Intuition) as a 
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vhole: not about the relative support It aay give to one hypotheses as 
opposed to another, but about Its ability to lend support to any hypothesis 
at all. 

If *31 the info mat Ion about the events in a set of gambles were in 

the form of sample-distributions, then ambiguity might be closely related, 

15 

Inversely, to the site of the sample. But sample-size is not a universally 
useful index of this factor. Information about many events cannot be 
conveniently described In terms of a sample distribution; moreover, sample* 
size seems to focus mainly on the quantity of information. "Ambiguity" may 
be high (and the confidence in any particular estimate of probabilities lov) 
even where there is maple quantity of information, when there are questions 
of reliability and relevance of information, and particularly where there 
is conflicting opinion and evidence. 

This Judgment of the a&blgulty of one's information, of the over-all 
credibility of one's composite estimates, of one's confidence in them, 
cannot be expressed In terms of relative 11 he! 1 hoods or events (if it 
could. It would simply affect the final, ocqpouad probabilities). Any 
scrap of evidence bearing on relative 11 low 11 hood should already be 
represented In those estimates. But having exploited knowledge, guess, 
ruoor, assumption, advice, to arrive at a final Judgaent that one event Is 
ooze likely than another or that they are equally likely, one can still 
stand back from this process and ask: "Hov much, in the end, is all this 
worth? Bov much do I really know about the problem? Sow firm a basis for 
choice, for appropriate decision and action, do I have?" The answer, "I 
don't know very much, and I can't rely on that," may sound rather familiar, 
even in connection with markedly' unequal estimates of relative likelihood. 
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If "complete ignorance" is rare or non-existent, "considerable" 
ignorance is surely not. 

Savage himself alludes to this sort of judgaent and notes as a 

difficulty with his approach that no recognition is given to it: 

...there seem to be some probability relations about which we 
feel relatively "sure" as compared with others...The notion of 
"sure" and "unsure" introduced here is vague, and my complaint 
is precisely that neither the theory of personal probability, 
as it is developed in this book, nor any other device known to 
me renders the notion less vague...A second difficulty, perhaps 
closely associated with the first one, stems from the vagueness 
associated with Judgments of the magnitude of personal 
probability. 16 

Knight asserts what Savage's approach tacitly denies, that such over- 

all Judgments may Influence decision: 

The action which follows upon an opinion depends as much upon 
the amount of confidence in that opinion as it does upon the 
favorableness of the opinion itself...Fidelity to the actual 
psychology of the situation requires, we must insist, recog¬ 
nition of these two separate exercises of Judgment, the 
formation of an estimate and the estimation of its value. ? 

Let us imagine a situation in which so many of the probability Judgnents 
an individual can bring to bear upon a particular problem Eire either 
"vague" or "unsure" that his confidence in a particular assignment of 
probabilities, as opposed to sane other of a set of "reasonable” distribu¬ 
tions, is very low. We may define this as a situation of high ambiguity. 

‘flie general proposition to be explored below is ic is precisely in 

situations of this cort that self-consistent behavior violating the Savage 
axioms may co:maonly occur. 

Ambiguity is a subjective variable, but it should be possible to 
identify "objectively" some situations likely to present high ambiguity, 

i 

by noting situations where available information is scanty or obviously 


unreliable or iii£hly conflicting; or where expressed expectations of 
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different individual* differ widely; or where expressed confidence In 
estimates tends to be low. Thus, as compared with the effects of familiar 
production decisions or veil-known random processes (like coin flipping or 
roulette), the results of Research and Development, or the performance of 
a new President, or the tactics of an unfamiliar opponent are all likely 
to appear ambiguous. This would suggest a broad field of application for 
the proposition above. 

In terns of Shackle's cricket exasple: Imagine an American observer 
who had never heard of cricket, knew none of the rules or the method of 
scoring, and had no clue as to the past record or present prospects of 
England or Australia. If he were confronted with a set of side bets as to 
whether England vould bat first—this to depend on the throw of a die or a 
coin—I expect (unlike Shackle) that he would be found to obey Savage's 
axioms pretty closely, or at least, to want to obey them If any discrepancies 
were pointed out. Yet I should not be surprised by quite different 
behavior, at odds with the axioms. If that particular observer were forced 
to gaable heavily on the proposition that ftigland would win the match . 

let us siqppose that an Individual must choose maong a certain set of 
actions, to whose possible consequences we esn assign "von lfeuoann- 
Morgeastern utilities" (reflecting the fact that in choosing among some set 
◦f "unambiguous" gables involving other events and these same outcomes, 
he obeys the Savage axioms). Ve shall suppose that by compounding various 
probability Judgments of varying degree* of reliability he can eliminate 
certain probability distributions crvrr the states of nature as "unreasonable," 
assign weights to others and arrive at a composite "estimated" distribution 
y° that represents all his available Information on relative likelihoods. 
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But Irk us further suppose that the situation Is mbiguous for him. Out of 
the set Y of all possible distributions there remains a set 1° of distribu¬ 
tions that still seen "reasonable," reflecting Jul&aents that he "mifht 
abaosx as vail” hare made, or that his Information—perceivr l as treaty, 
unreliable, ambiguous—doec not permit him confidently to rule cut. 

In choosing between two actions, I and II, he can compute their 
expected utilities in terms of their payoffs sad the "estimated" probability 
distribution y°. If the likelihoods of the events In question were as 
unambiguous as those in the situations in which his von Neuiann-Morgen stem 
utilities were originally measured, this would be the end of the matter; 
these payoffs embody all his attitude* toward "risk," and expected values 
will correspond to his actual preferences meong "risky" gambles. But In 
this case, where his final asslgnsaot of probabilities is less confident, 
that calculation asy leave him uneasy* 'So I has a lover expectation 
than Q, on the basis of these estimates of probabilities," he may reflect; 
"Bov much does that tall net That's not much of a reason to choose II." 

In this state of mind, searching for additional grounds for choice, 
he may try new criteria, ask new questions. For any of the probability 
distributions In tbs "reasonably possible" set Y°, he can coqpute an 
expected value for each of his actions. It might now occur to him to ask: 
"What might happen to me if ^ best estimates of likelihood don't apply? 

What la the worst of the reasonable expectations of payoff that I might 
associate with action IT With action II?" Be might find that he could 
answer this question about the lower limit of the reaeonable expectations 
for a given action much mare confidently than he eould arrive at a single, 


"best guess" expectation; the latter estimate, he might suspect, might vary 





almost hourly vlth his mood, whereas the former might look m uc h more solid, 
almost a "fact," a piece of evidence definitely worth considering In making 
his choice. In almost no cases (excluding "complete Ignorance" as 
unrealistic) will the only fact worth noting about a prospective action 

v 

be Its "security level": the "worst" of the expectations associated with 
reasonably possible probability distributions. To choose on a "maxlnin" 
criterion alone would be to Ignore entirely those probability judgaents 
for which there Is evidence. But In situations of high ambiguity, such a 
criterion may appeal to a conservative person as deserving some weight, 
when interrogation of his own subjective estimates of likelihood has 
failed to disclose a set of estimates that compel exclusive attention in 
his decision-making. 

If, in the end, such a person chooses action I, he may explain: 

"In teas of my best estimates of probabilities, action I has 
almost as high an expectation as action II. But If my best 
guesses should be rotten, which wouldn't surprise as, action 
I gives as batter protection; the worst expectation that looks 
reasonably possible lma't much worse than the "bast guess" 
expectation, whereas with action IX It looks possible that 
ny expectation could really be terrible." 

An advocate of the Savage axioms as normative criteria, foreseeing 

where such reasoning will lead, may Interject in exasperation: 

"Why are you double-counting the "to ret" possibilities? They're 
already tak e n into account In your over-all estimates of likelihoods, 
weighted in a reasoned, realistic way that represents— by your own 
claim—your best Judgaant. Once you've arrived at a probability 
distribution that reflects everything you know that's relevant, 
don't fiddle around with it, use it. Btop asking irrelevant 
questions and whining about how little you really know." 

But this may evoke the calm reply: 

"It's no use bullying me Into taking action II by flattering my 
'best Judgaent.' I know how little that's based on; I'd cack it 
if we were betting with pennies, but I want to know soma other 
things If the stakes are important, and 'How much might I expect 
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to lose, without being unreasonable?' Just strikes me as one of 
those things. As for the reasonableness of giving extra weight 
to the "bad" likelihoods, my teat for that is pragnatic; in 
situations where I really car.'t Judge confidently among a whole 
range of possible distributions, this rule steers me toward actions 
whose expected values are relatively insensitive to the particular 
distribution in that range, without giving up too much in terns of 
the "best guess" distribution. That strikes ne as a sensible, 
conservative rule to follow. What's vronf vita it? 

"What's wrong with It" la that it will lead to violations of Savage's 

Postulate 2, and will make it impossible for an observer to describe the 

subject's choices as though he were maximizing a linear combination of 

payoffs and probabilities over events. Neither of these considerations, 

even on reflection, may pose to our conservative subject overwhelming 

imperatives to change hi3 behavior. It will not be true that this beliavio 

is erratic or unpredictable (we shall formalize it in terns of a decision 

rule below), or exhibits intransitivities, or amounts to "throwing away 

utility" (as would be true, for exmaple, if it led )JLm occasionally• to 

choose strategies that were strongly "dominated" by others). There i3, 1. 

fact, no obvious basis for asserting that it will lead him in the long run 

to worse outcomes than he could expect if he reversed some of hi;; prefereji 

to conform to the Savage axioms. 

Another person, or this same person in a different situation, night 
liavc turned instead or in addition to same other criteria for guidance. 

One night ask, in an ambiguous situation; "What is the best expectation I 
mlglit associate with this action, without being unreasonable?" Or; "What 
is its average expectation, giving all the reasonably possible distributioi 
'quad weight?" The latter consideration would not, as it happens, lead to 
_K3ht.vior violating the Savage axioms. Tne former would, in the nazae faahic 
uTiOjgh in uie oj>>»ite direction as iltn "rait'lnun" criterion discussed abov< 
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indeed, this "maxlnaxing" consideration could generate the minority behavior 
of those who, in our urn example, prefer II to I and III to IV. Both these 
patterns of behavior could be described by a decision rule similar to the 
one below, and their respective rationales nig^rt be similar to that given 
above. But let us continue to focus on the particular pattern discussed 
above, because it seems to predominate empirically (at least, vlth respect 
to our examples) and because it most frequently corresponds to advice to 
be found on decision •making in ambiguous situations. 

In re soiling his decision, the relative weight that a conservative 

person will give to the question, "What is the worst expectation that might 

appear reasonable?" will depend on his confidence in the judgaents that go 

into his estimated probability distribution. The less confident he is, 

the more he will b<±cr'fice in terms cf estimated expected payoff to achieve 

a given Increase in "security level"; the more confident, the greater 

Increase in "security 3 vel" he would demand to oaspensate for a given drop 

in estimated expectation. This implies that "trades" are possible between 

security level and estimate*, '■"pectation in hie preferences, and that does 

seen to correspond to observed rea*aases. Many subjects will still prefer 

to bot on Rjj than in our first axaapha even whan the proportion of Red 

to Black in Urn II Is lowered to 49:51/ or will prefer to bet on Red than 

on Yellow in the second example even when one Red ball is removed from the 

urn. But at s ome point, as tha "unambiguous" likelihood beoomes 

13 

increasingly unfavorable, their choices will switch. 

AseuninG, purely for simplicity, that these factors enter into his 
decision rulr in linear combination, we can denote by /O his degree of 
confidence, in a given state of information ambiguity. In the estimated 
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dl8trlbution y°, which in turn reflects all of his Judgnents on the 
relative likelihood of distributions, including Judguenta of equal likeli¬ 
hood. Let min^ be the minimum ejected payoff to an act x as the probability 
distribution ranges over the set Y°; let es'c^ be the expected payoff to the 
act x corresponding to the estimated distribution y°. 

The simplest decision rule reflecting the above considerations would 
19 

be: Associate with each x the index : 

*est + (1- -°) * min 

X. x 

Choose that act with the highest index . 

An equivalent formulation wauld be the following, where y° is the 
estimated probability vector, y^ n the probability vector in Y° correspond!: 
to action x: Associate with each x the index : 

[ r: jf" J(x) 

Choose that act with the highest index . 

In the case of the Red, Yellow and Black balls, supposing no samples 
and no explicit information exoept that l/3 of the balls are Red, many 
subjects might lean toward an estimated distribution of (1/3, l/3> l/3) ; 
if not from "igoorance, M then from counterbalancing considerations. But 
many of these would find the situation ambiguous; for them the "reasonable" 
distributions Y° might be all those betwsen (l/3, 2/3, 0) and (1/3, 0, 2/3). 
Assualng fbr purposes of illustration ■ l/4 (Y°, y°, X and & are all 
subjective data to be Inferred by an observer or supplied by the individual, 
depending on whether the criterion is being used descriptively or for 
convenient declsion-asking), the formula for the index wauld be; 

i .est ♦ \ min . 

4 x 4 x 
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The relevant data (assigning arbitrary utility values of 6 and 0 to the 
raoney outcomes $100 and $0) would be: 


I 

II 

III 

IV 


Red Yellow Black Min Est I n d e x 
_ x x 


6 

0 

0 

2 2 

2 

0 

6 

0 

0 2 

• 5 

6 

0 

6 

2 4 

2.5 

0 

6 

6 

4 4 

4 


A person conforming to this rule with these values would prefer I to II 

and IV to III, In violation of the Sure-thing Principle: as do most people 

queried. In justifying this pattern of behavior he might reproduce the 

rationale quoted above (^.v.); but most verbal explanations, somewhat lens 

articulately, tend to be along these lines: 

The expected payoff for action I is definite: 2. The risks under 
action II may be no greater, but I know what the risk la under action 
I and I don't under action Q. The expectation for action II is 
ambiguous, it might be better or it might be worse, anything from 
0 to 4. To be on the safe side. I'll assume that It's closer to 
0; so action I looks better. Qy the sene token, IV looks better 
than III; I know that ay axpacted p^off with IV Is 4, whereas 
with III it might be as low as 2 (which isn't coqpensated by the 
chance that It could be 6). 

Leaving the advocate of the Savage axioms, If he is still around to 
hear this, to renew his complaints about the silliness and Irrelevance of 
such considerations, let us note a practical consequence of the decision 
rule which the above consent brings into focus. It has already been 
mentioned that the rule will favor—other thing* (such as the estimated 
expectation) being roughly equal—actions whose expected value Is less 
sensitive to variation of the probability distribution within the range 
of ambiguity. Such actions may frequently be those definable as "status 
quo" or "present behavior" strategies. 
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A familiar, ongoing pattern of activity may be subject to co n s i derable 
uncertainty, but this uncertainty is more apt to appear In the form of 
"risk"; the relation between given states of nature is known precisely, and 
although the randan variation in the state of nature which "obtains" may be 
considerable, Its stochastic properties are often known confidently and in 
detail. (Actually, this confidence may be self-deceptive, based on ignoring 
some treacherous possibilities; nevertheless, it commonly exists). In 
contrast, the ambiguities surrounding the outcome of a proposed innovation , 
a departure from current strategy, nay be much more noticeable. Different 
sorts of events are relevant to its outcome, and their likelihoods must now 
be estimated, often with little evidence or prior expertise; and the effect 
of a given state of nature upon the outcome of the new action may itself be 
In question. Its variance may not appear any higher than that of the 
familiar action when confuted on the basis of "best estimates" of the 
probabilities involved, yet the meaolngfulness of this calculation may be 
subject to doubt. The decision rule discussed will not preclude choosing 
such an act, but It will definitely bias the choice sway from such ambiguous 
ventures and toward the strategy with " known risks." Thus the rule is 
"conservative" In s sense more familiar to everyday conversation t)iar. to 
statistical decision theory; it may often favor traditional or current 
strategies, even pexlups at high risk, over innovations whose consequences 
are undeniably ambiguous. This property may recommend it to acme, discredit 
it with others (some of whom might prefer to reverse the rule, to emphasize 
the more hopeful possibilities in ambiguous situations); it does not seem 
irrelevant to one's attitude toward the behavior. 

In the equivalent formulation in terms of y^ 1 and y°, the subject 
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could be described "as though" he were assigning weights to the 
ctlve payoffs of actions II and IH, whose expected values are 
ycus, as follows (assualng y° - (l/3» l/3> 1/3) 1° eatCh case): 

II 

III 

ugh the final set of weights for each set of payoffs resemble proba- 
ies (they are positive, sun to unity, and represent a linear cqoablna- 
of two probability distributions), they differ for each action, since 
will depend on the payoffs for x and will vary for different actions, 
ese weights were interpreted as "probabilities, M we would have to 
d the subject's subjective probabilities as being dependent upon his 
fs, his evaluation of the outcome. Thus, this model would be 
prlate to represent earns of true pesslmlms, or optiaien/wishfulness 
y^** substituting for y^ 11 ). However, in this case we are assuaing 
rvatlsm, not pessimism; our subject does not actually expect the 
, but he chooses to act " as though" the worst were somewhat more 
y then his bait estimates of llhtllhood would indicate . In either 
he violates the Savage axioms; it is impossible to Infer from the 
ting behavior a set of probabilities for events independent of his 
fs. In effect, he "distorts" his best estimates of likelihood, in 
i recti on of Increased emphasis on the less favorable outcomes and to 

OQ 

zee depending on/°, his confidence in his best estimate. 

Hot only does this decision model account fbr "deviant" behavior In a 
cular, mnbiguous situation, but it covers the observed shift in a 
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Mbject's behavior as mnbiguity decreases. Suppose that a ample Is 
drawn from the urn, strengthening the confidence in the best estimates of 
likelihood, so that /° increases, say, to ?/*• Ike weights far the payoff? 
to actions II and. HI would, nov be: 

p. 7° ♦ <M yf 1 

n ( 5- i< il) 
m ( y if> I 5 

and the over-all Index would be: 



Index 

T 

2 

u 

1.5 

HI 

3-5 

IV 

4 


In other words, the relative Influence of the consideration, “What Is the 
worst to be expected?” won the comparison of actions Is lessened. The 
final weights approach closer to the "best estimate" values, end I and II 
approach clostr to Indifference, as do HI and IV. This latter aspect 
might show w behaviorally in the amount a subject is willing to pay for a 
given bet on Yellow, or on (Red or Black), In the two situations. 

In the Holt, as mblgulty dlainlobes for one reason or another and 
/° approaches 1, the estimated distribution will cans Increasingly to 
dominate decision. With confidence in the best estimates high, behavior on 
the basis of the proposed decision rule will roughly conform to the Savage 
axioms, and It would be possible to infer the estimated probabilities from 
observed choices. But prior to this, a large number of Information states, 
distinguishable from each other sod all far removed from "complete 
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ice," might all he sufficiently ambiguous as to lead many decision- 
to conform to the above decision mile with /°< 1, in clear 
Lon of the axioms. 

re they foolish? It is not the object of this paper to Judge that, 
been concerned rather to advance the testable propositions: (l) 
i information states can be Meaningfully identified as h ig hl y 
oub; (2) in these states, many reasonable people tend to violate the 
axioms with respect to certain choices; (3) their behavior is 
rate and not readily reversed upon reflection; (4) certain patterns 
olating" behavior can be distinguished and described in terms of a 
Led decision rule. 

f these propositions should prove valid, the question of the 
Lity of this behavior would gain more interest. The mere fact that 
Clicts with certain axioms of choice that at first glance appear 
ibLe does not team to me to fore do ae thia question; empirical 
:h, and even preliminary speculation, about the nature of actual or 
isful" decision-mailing under uncertainty is still too young to give 
ridsnoe that thsse axioms are not abstracting away from vital consider 
It would seam incautious to rula peremptorily that the people in 
» should not allow their perception of antoiguity, their unease with 
test estimates of probability, to Influence their decision: or to 
that the manner in which they respond to it la against their long- 
tarest and that they would be in tome sense better off if they should 
Inst their deep-felt preferences. If their rationale for their 
on behavior la not wlquely compelling (and recent discussions with 
elllng have raised questions in my mind about it), neither, it seems 


to me, are the counterarguaents. Indeed, it seems out of the question 
suaaarily to Judge their behavior as irrational: I m included among then 
In any case, it follows from the propositions above that for their 
behavior in the situations in question, the Bayesian or Savage approach 
gives wrong predictions and, by their limits, bad advice. They act in 
conflict with the axions deliberately, without apology, because It seems 
to them the sensible way to behave. Are they clearly mistaken? 
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FOOTNOTES 

^ Knight, F. H., Risk, Uncertainty and Profit , Houghton Mifflin Co., 
Bojton, 1921. But 3ee Arrow ’0 comments: "In brief, Knight'a uncertain¬ 
ties seen to have surprisingly many of the properties of ordinary 
probabilities, and it is not clear bow much is gained by the distinction 
... .Actually, his uncertainties produce about the same reactions in 
individuals as other writers ascribe to risks." Arrow, K. J., 

"Alternative Approaches to the Theory of Choice in Risk-taking Situation," 
Econonetrlca , Vol. 19, October 1951/ PP* **17,- **26. 

p 

^ Shackle, G. L. S., Uncertainty in Economics (Cambridge 1955)/ 
p. .S. if tills exargxLe were not typical of a number of Shackled work, 
it would seen almost unfair to cite it, since it appears so transparently 
inconsistent with coianonly-observod behavior. Can Shackle really believe 
t’uat an Australian captain who cared about batting first would be 
indifferent between staking this outcome on "heads" or on an ace? 

^ Ramsey, F. P., "Truth and Probability" (1926) in The Foundations 
of .Mathematics and Other Logical Essays , London, 1931; Savage, L. J., 

The Foundations of Statistics , New York, 1951; de Finetti, I:., "Recent 
o-ggestions for the Reconciliation of Theories of Probability," pp. 217- 
; 01 ' Proceedings of the 3econd (1950) Berkeley .tyriposlun on Mathematical 
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Statistics sad Probability, Berkeley, 1951; Sippes, P. (see Suppee, P., 
Davideon, D., and Siegel, 8., Decision Making, Ttanfbrd, 1957) • Closely 
XSLAted approach*a, la which Individual choice behavior is presumed to be 
stochastic, have been developed by Luce, R. 0., Individual Choice Behavior, 
lev York, 1959* end Chipman, J. 8., "Stochastic Choice and Subjective 
Probability," in Decisions, Valuta and groups, ad. Wlllner, D., Rev York, 
I960, Although tbs arguasnt in this psper applies equally veil to these 


latter stochastic aadon systaaui, they will not be discussed explicitly. 

4 

Beasay, p. 171* 

** Op. cit ., p. 21. Savage notea that the principle, in the form •'f 


the rationale above, "oannot appropriately be accepted as a postulate In 
the sense that PI is, because It would introduce nev undefined technical 
terms referring to knowledge and possibility that would render It nathe- 


natlcally useless without still more postulates governing these terry*." 

Bt substitutes for it a postulate co r respo n ding to P2 above as expressing 
tbs seas Intuitive constraint. Savage's PC corresponds closely to 
"Rubin's Postulate" (Luce and Raiffb, Qamss and Decisions, Nev York, 1957, 
p. 290) or Minor's "Coluan Linearity" postulate, Ibid ., p. 297 , vhlch 
ljqply that adding a constant to a coluan of payoffs should not change the 
preference ordering among acts. 

If numerical probabilities were assumed known, so that the subject 
were dealing explicitly with known "risks," these postulates would amount 
to Sea tel son's "Special Independence Assumption" ("Probability, Utility, 
and the Independence Axiom," Econometrics , 20 , 67 O- 7 Q, 1952) on which 
Saauelson relies heavily In his derivation of "von Neunann-Morgenstem 
ullltles." 








ill 


6 I bet. 

7 

' Note that In no case are you Invited to choose both a color and an 
urn freely; nor are you given any Indication beforehand aa to the full set 
of gsables that will be offered. If these conditions vere altered (as In 
some of H. Raiffa's experiments with students), you could enploy randomized 
strategies, such as flipping a coin to determine what color to bet on In 
Urn I, which night affect your choices. 

Q 

Bare we see the advantages at purely hypothetical experiments. 2h 
"real life," you would probably turn out to have a profound color prefer¬ 
ence that would Invalidate the whole first set of trials, and various 
other biases that would show up one by one as the experimentation 
progressed inconclusively. 

H owev er , the results In Chlpssm's almost ldentloal experiment (op . 
clt ., pp. 87-88) do give strong support to this finding; Chlpnan's 
explanatory hypothesis differs from that p r spossl below. 

^ m order to relate these ohoioes clearly to the postulates, let us 
change the experimental setting slightly. Let us as sums that the balls In 
Urn I are each narked with a I, and the balls In Urn II with a II; the 
contents of both urns are then duoped into a single urn, which then con¬ 
tains 50 Hsdjj balls, 50 Blacky balls, and 100 Redj and Bl a cky balls In 
unknown proportion (or in a proportion Indicated onl; by a small random 
sample, say, one Red and one Black) . The following actions are to be 


considered: 
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100 50 50 

lab b b 

II b a b b 

in b b a b 

IV b b b a 

V a a b b 


VI b b a a 

Let us aasune that a person is indifferent between I and II (between 
betting on or B ^), between HI end IV and between V and VI. It would 


then .follow froa Postulates 1 and 2, the assumption of a complete ordering 


of actions and the Sure-thlng Principle, that I, II, HI and IV are all 
indifferent to each other* 

To lndloate the nature of the proof, suppose that I is preferred ^ 
III (the person prefers to bet on Itj rather than Rjj) . Postulates 1 and 2 
lsqply that c attain transforaatlons oan be ps r f oru ed on this pair of action* 


without affaotlna their ar af C r aooa ordering; specifically, one action can 
be replaced by an notion Indifferent to it (PI — complete ordering) and 
the walua of a constant eolun oan be changed (PS — Sure -thing Principle) 
Thus starting with I and III and pnrforning such "admissible trs” >- 


formation^* it would follow from FI and P2 that the first action in each of 
tbs following pairs should be prefarred: 
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®n 

*11 

®IX 


I 

a 

b 

b 

b 


m 

b 

b 

a 

b 


i* 

a 

b 

b 

a 

PS 

in* 

b 

b 

a 

a 


i" 

a 

1 

b 

a 

PI 

m" 

a 

a 

b 

b 


i'" 

b 

b 

b 

a 

P2 

nr" 

b 

a 

b 

b 


j» * • • 

b 

b 

a 

b 

PI 

m"" 

a 

b 

b 

b 



Contrmdlctloo: I preferred to III, and X'*'* (equivalent to IH) 
preferred to III"" (equivalent to l). 

10 Kalgfat, op. elt ., p. 219. 

^ Kenneth Arrow ha* suggested tbs ffellovlac In tbs spirit 

of tbs above one; 

JfiO 90 90 

*x *x *11 *n 

Z a a b b 

n a b a b 

ZZZ b a b a 

XT b b a a 

Assvaaa that I is indifferent to IV, II la Indifferent to in. 

Juppose that I is preferred to 11; efcet is the ordering of III and IV? 

If in Is not preferred to IV, PB, the Sure-flfalng Principle Is violated. 

If IV Is not preferred to m, PI, complete ordering of actions, Is 

violated. (If in Is Indifferent to IV, both PI and P2 are violated.) 

12 

Iart the utility peoroff* corresponding to $100 end $0 be 1, 0; let 
Py P 2 * b® the probabilities corre s p on ding to Rod, Yellow, Black. The 
expected value to action I la then P^; to n, P^; to III, + Py to 










I v, f 2 ♦ fy But 


But there are no P's, > o- 27^ - 1, s<jeh that P, > Pg 



P., "Probability and tba Attests to Measure Utility/ 


(Tolqro, Japan), July 1950, pp. 169*170 


To taat tba predictive effectiveness of tha axioms (or of tba alter- 
Data tad aloe ruin to be proposed In tha next section) in thaae situations 
control let expert nantstlnn la In order. (Baa Chlpaan's ingenious expertnet 
0£. dt.) But, as Straps raaaxfcs (or. clt., p • 26) , tba note of Interroga¬ 
tion lap!led base and In Savage's book, asking "the parson not bov be 
but ehat ha souLA do In each and auofa a situation" and glvlac bln aqpl* 
opportunity to ponder the Implications of his repllee, aaene quite sppropr* • 
ate in veiling "the theory's nora Shortest normative Interpretation.‘ 
Noraovar, the as uun a sp a rt na nt a l oba ar va t lons oan hare at least negative 
empirical Inplloatlena, alnea there la a praauction that people v^s* 
lnatlnetlva oheleee vi o l ate the Savage edee, and ubo claim upon further 
reflection thad they do eet eat to Ofeqr then, do not tend to obey than 
wanally in mob dteatlOM. 

14 Bo one tan deirt^one seen beead on "ragrats" could violate the 
Burs thing Principle, o le oo ell oonetent oolueno of poyoffa would tranafom 
to e coloan of O'o la tana of "snpvt"; on the other bond, such a parson 
wuld violets PI, ooepiete ordering of otntegles. 

15 

fiat Chlpnan, 0 dt., pp. 75# 93* Chlpaan'a h^ortant work In 
this area, dona Inde penden tly and largely prior to nine, la not discussed 
bare alnea It embodies a stochastic theory of choice; Its spirit la 
otba visa closely similar to that of tha present approach, and his experi¬ 
mental results are both pertinent and favorable to the hypotheses belov 
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(though Hiljanri's infernoone art «o—vhat different). 

8m also the osawta by V. OsorgMou latpa an notion of 
"credibility," a oanoept ldontlcnl to "Mhigirtty" in this paper: TBbn 
ktm of fcy o c U tt a n sad ItaoartalBty," 1 a toectatlona, qboartalntr. and 
WnolnoM fehnrloar. od. Mazy BeMK, tooial S ci enc e He March Council, 

■nr loch, 1998* pp. 24-26; and Thdoe, Expect ati on s «d Measurability," 
Quarterly Journal of IcnwriPi , M. IXVXXX, Bo. 4, Sovanber 1954, 
pp. 527-530. XhoM highly pertinent artlclee om to ay attention only 
after thla paper had ■one to the printer, allowiad no ^aoe tor ooMant 
bare. 

it jwpt dt., pp. 57 - 58 * 59 * I m p later «mi ao far aa to 
nigpet (ep. dt., pp* 1 £ 6 - 169 ) feat tta "earn of vnganeee" attached to 
aany JudgMnta of paraaaal pnMdU% *10* load to qretaMdc rlolatlone 
of da alaa, althen# tha dnddan nla ha dlaauaaM aa altannctlTa— 
alalnidag ragpet—a«M%# aa Mttanl it feetnete 14 above, oooount for 
the babarlar la oar waited. 

17 Kd*t, ft. m*, t* 

^ fda wnlwdlda t*a aaaefelaae by ffbip—i (g. dt.* p. 08 ) and 
OeoifMcu^toagM (tbatee, lpirtiHlii fed MaaaurablUty," pp. 527-530), 
end 'The fetors of jpntaHw and tttiwrtalnty," 9. 85) fefe individual* 
order uncertainty -eltaatlfee Indeagaapbiaally In tana of tenanted 

expectation and "credibility" (fedgdty); fedguity appears to influence 

choice even Then eatiaatad expectations are not equivalent. 

19 

This rule le baaed upon the ooooept of a "restricted Bayes 
so lu tion” developed by J. L. Hodges, Jr., and X. L. Jjatiaatm ("The Uses of 
Previous Experience in Reaching Statistical Decision,'' *»«i« of 
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MMdMMMnel dtatiatloe, m. 23, ft>. % Septraber, 1952, »• 396-407, 

B» throt^Mt Section m of this paper deriree hacrlly tram 

the Baits* ad UImb aifMBt, althcutfi thalr *pproach la activated rad 

See also, L. BHnd.es, '“Boss ■pacification Problra* rad Application* 
to BscocMs t rlc Bodela," l<— trloa. fol. 19, *>• 3, July, 1951, BP* 
JO*}44 (abetraet). Shi* tel* nth ths era* aort of problra mad present* 
s iriVu ‘ >mt— ■Intsar principle" equivalent, In sore mural fora, 
to tfaa d aemon rala Z proposed In ra earllar ersanstotian of thl* paper 
fTiind ii. I960); bat both of than* Inched the crucial notion* developed 
la t tm Maim* art Lriran mnaah of a "boat eetinate" distribution y° 
rad a "oanfldenoe" parrailir 

80 mi loMsprabdttra at Mm brtMrtor-pattam oontraat* to tha 
byfolMMdd «r rttlrtra raid MnmM ^ Miner la tbs aoorapra&iua 
tftlald Id MU dMMid. ftUrar aaraa vaadabahsbly bo ba deal Inc nth 
MM agM ylMMBBM Mddsoaad boo, ail his proposed teMalfue of M a tur ing 
a parora'* iMJmMm fwMMIIHtdi art vrtUitte* la relatively 

ranrao of aov data and hffiiMssM Moreover, hi* da s cr i p tlw data rad 
intuitive soajo c t u ra e load nantfag «pport to the finding* raportad 
her*. Bora v sr, hi* solatia* to th* problra opposes a single sat of 
volost* dstaalaad Independently of payoff* (presuoably corresponding to 
Vi* "boat astlaata*" bora) and a "correction factor," reflecting tha 
degree of rabigulty or oonfldanoa, Milch operate* on thee* weight* in a 
tanner lndapeadrat of tha structure of payoff*. I ra not entirely clear 
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oq tim behavioral ig^Hcmtloaa of Miner'c aodel or the decision rule It 
Implies, but in rlew of these properties 1 so dodbtful whether it can 
account •daq'jetely for all the behavior dioousaed above. 






